United States R\tent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
Umtod States Patent and Trademark Office \ 
Address: COMMISSIONER OF PATENTS AND TRADEMARKS 

Washington. D.C. 20231 

www.usplo.gov 



APPLICATION NO. 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. ~| 


09/098,544 


06/17/1998 


TAKAAKI END0 


2355.10102 


4229 



5514 7590 03/25/2002 

FITZPATRICK CELLA HARPER & SCINTO 
30 ROCKEFELLER PLAZA 
NEW YORK, NY 10112 



EXAMINER 



LEE, RICHARD J 



ART UNIT 



PAPER NUMBER 



2613 

DATE MAILED: 03/25/2002 



Please find below and/or attached an Office communication concerning this application or proceeding. 



PTO-90C (Rev. 07-01) 



Office Action Summary 


Application No. 
09/098.544 


Applicant(s) 

Endo et al 


Examiner 

Richard Lee 


Art Unit 

2613 













- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136 (a). In no event, however, may a reply be timely filed 

after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will 

be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this 

communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 

earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 ) ixi Responsive to communication(s) filed on 12/4/01 and 1/28/02 . 



2a) □ This action is FINAL. 



2b) K This action is non-final. 



3)D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 
closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11; 453 O.G. 213. 



Disposition of Claims 

4)fxi Claim(s) 1-23 



4a) Of the above, claim(s) 
5)D Claim(s) 



6) K Claim(s) 1-23 

7) D Claim(s) 

8) D Claims 



is/are pending in the application. 
_ is/are withdrawn from consideration. 

is/are allowed. 

is/are rejected. 

is/are objected to. 



are subject to restriction and/or election requirement. 



Application Papers 
9)D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are objected to by the Examiner. 

1 1 )□ The proposed drawing correction filed on is: a)D approved b)D disapproved. 

1 2) D The oath or declaration is objected to by the Examiner. 

Priority under 35 U.S.C. § 119 

13) D Acknowledgement is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d). 
a)D All b)D Some* c)D None of: 

1 . □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. 



3. □ Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
*See the attached detailed Office action for a list of the certified copies not received. 

14)D Acknowledgement is made of a claim for domestic priority under 35 U.S.C. § 1 19(e). 
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1 . The request filed on January 28, 2002 for a Request for Continued Examination (RCE) is 
acceptable and a RCE has been established. An action on the RCE follows. 

2. The applicants' arguments from the amendment filed December 4, 2001 have been noted, 
considered, and addressed in the following new grounds of rejections. 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless -- 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or 
on sale in this country, more than one year prior to the date of application for patent in the United States. 

4. Claims 1-5, 10-16, 20 and 22 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Lanckton et al of record (5,517,419). 

Lanckton et al discloses an advanced terrain mapping system as shown in Figure 1, and the 
same image recording apparatus and method for recording images sensed by at least two image 
sensing means attached to a vehicle and a recording medium of a computer program which makes 
a computer execute control for recording images as claimed in claims 1-5, 12-16, 20, and 22, 
comprising the same first image sensing means which is arranged to have an image sensing 
direction agreeing with a first direction of the vehicle, wherein the first image sensing means 
comprises a plurality of cameras, image sensing directions of which are deployed symmetrically 
about the first direction, wherein straight lines on the image sensing directions of the plurality of 
cameras cross each other in front of the plurality of cameras (see column 4, lines 9-19, column 7, 
line 1 5 to column 8, line 29); second image sensing means which is arranged at a position 



# 

Application/Control Number: 09/098,544 Page 3 

Art Unit: 2613 

separated a known distance from the first image sensing means to have an image sensing direction 
agreeing with a second direction substantially 1 80 degrees different from the first direction, 
wherein the second image sensing means comprises a plurality of cameras, image sensing 
directions of which point in at least two directions symmetrical about the second direction (see 
column 7, line 15 to column 8, line 29); recording means for, when the vehicle travels in the first 
direction, associating first image data sensed by the first image sensing means with second image 
data sensed by the second image sensing means and recording the first and second image data 
sensed at different times from each other and with information concerning a time difference based 
on the known distance and a velocity of the vehicle (i.e., image and position data are correlated 
for a given area of terrain in order to record and retrieve positioning information thereby 
providing the recording of image data with information concerning a time difference based on the 
known distance, and the actual rate at which image data is captured and recorded is based on the 
speed (velocity) of the vehicle, see column 2, lines 35-38, column 4, lines 9-19, column 7, line 15 
to column 8, line 29, and column 10, lines 19-31); third image sensing means which is arranged at 
a position near the first image sensing means to have an image sensing direction agreeing with a 
third direction different from the first direction, and fourth image sensing means which is arranged 
at a position symmetrically to the third direction about a straight line pointing in the first direction 
(see column 7, line 15 to column 8, line 29); and first program code means for, when the vehicle 
travels in the first direction, recording first image data sensed by the first image sensing means and 
second image data sensed by the second image sensing means in association with each other based 




# 
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on time duration information based on the known distance and a velocity of the vehicle (i.e., 
image and position data are correlated for a given area of terrain in order to record and retrieve 
positioning information thereby providing the recording of image data with information 
concerning a time difference based on the known distance, and the actual rate at which image data 
is captured and recorded is based on the speed (velocity) of the vehicle, see column 2, lines 35-38, 
column 4, lines 9-19, column 7, line 15 to column 8, line 29, and column 10, lines 19-31). 

In addition, Lanckton et al shows the same image database apparatus for generating a 
database used for building a three-dimensional image space from image sequences sensed by a 
plurality of image sensing means attached to a vehicle after acquisition of image data (see columns 
9-12) as claimed in claims 10 and 1 1 , comprising the same first reader for reading data from a first 
image memory recorded by first image sensing means pointed in a first direction (see columns 4, 
lines 9-U0, column 7, line 15 to column 8, line 29, column 10, lines 19-31, lines 58-67, column 13, 
lines 8-12); a second reader for reading data from a second image memory recorded by second 
image sensing means which is arranged at a position separated a known distance from the first 
image sensing means to point in a second direction substantially 180 degrees different from the 
first direction (see columns 4, lines 9-10, column 7, line 15 to column 8, line 29, column 10, lines 
19-31, lines 58-67, column 13, lines 8-12); a third reader for reading data from a third memory 
which records a moving position and traveling direction of the vehicle, and means for associating 
image data read by the first reader, and image data read by the second reader based on time 
duration information based on the known distance and a velocity of the vehicle, with each other 
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when traveling direction data read by the third reader indicates that the vehicle is traveling 
substantially straight (i.e., image and position data are correlated for a given area of terrain in 
order to record and retrieve positioning information thereby providing the recording of image data 
with information concerning a time difference based on the known distance, and the actual rate at 
which image data is captured and recorded is based on the speed (velocity) of the vehicle, see 
column 2, lines 35-38, columns 4, lines 9-19, column 7, line 15 to column 8, line 29, column 8, 
lines 59-67, column 9, lines 1 1-55, column 10, lines 19-31, lines 58-67, column 13, lines 8-12); 
and wherein when the second image sensing means includes two cameras having different 
directions (see column 7, line 15 to column 8, line 29), the associating means associates image 
data read by the first reader and image data at a position the known distance later of those read by 
the second reader from the camera located at a counterclockwise or clockwise position each 
other, when the traveling direction data read by the third reader indicates a clockwise or 
counterclockwise turn (see column 4, lines 9-19, lines 52-58, column 7, line 15 to column 8, line 
29, column 9, lines 24-55, column 10, lines 19-31, lines 58-67) 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 

rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 1 02 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 
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6. Claims 6-9, 17-19, 21, and 23 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Lanckton et al as applied to claims 1-5, 10-16, and 20 in the above paragraph (4), and 
further in view of Lachinski et al of record (5,633,946). 

Lanckton et al discloses substantially the same image recording apparatus and method as 
above, further including first program code means for detecting a turn of the vehicle (see columns 
4, lines 9-19, column 7, line 15 to column 8, line 29, column 9, lines 24-55, column 10, lines 19- 
31, lines 58-67); and wherein the plurality of cameras have two cameras, and the image sensing 
directions of the cameras cross each other on an extending line of the second direction, wherein 
the plurality of cameras have first to third cameras, the first camera has an image sensing direction 
agreeing with the second direction, and the image sensing directions of the second and third 
cameras are respectively turned clockwise and counterclockwise to be deployed symmetrically 
about the second direction (see column 4, lines 9-19, column 7, line 15 to column 8, line 29). 

Lanckton et al does not particularly disclose, though, the followings: 

(a) second program code means for selecting the camera which points at a larger angle in a 
counterclockwise or clockwise direction from the plurality of cameras depending on whether the 
vehicle has turned clockwise or counterclockwise from the first direction as claimed in claims 6, 

1 7, and 2 1 ; and 

(b) the selection means selects the first camera when the vehicle travels in the first 
direction, the second camera when the vehicle turns counterclockwise, and the third camera when 
the vehicle turns clockwise as claimed in claims 8 and 19. 



Application/Control Number: 09/098,544 Page 7 

Art Unit: 2613 

Regarding (a) and (b), the particular selection of any desired camera from a plurality of 
cameras in general is old and well recognized in the art. For example, Lachinski et al discloses a 
method and apparatus for collecting and processing visual and spatial position information from a 
moving platform as shown in Figures 1-4, and teaches the conventional use of a digital matrix 
router 23 of Figures 3 and 4 for providing any desired or selected image source(s) from video 
cameras 50 and four view generator 62 (see column 4, lines 35 to column 5, line 40, column 7, 
and Figures 3 and 4). In addition, it is considered obvious that if such image video sources may 
be selected by Lachinski et al, then such video sources may be selected from the plurality of 
cameras so as to provide one that produces a larger angle view. Essentially, if an object of 
interest is desired to be obtained, it is certain that the camera closest to the object will provide the 
largest angle of the image from among the plural cameras. And since Lachinski et al teaches the 
selective image source(s) from among a plurality of cameras, it is obvious that the one providing 
the largest angle may be selected, or for that matter the first, second, or third camera may be 
selected, for further processings as claimed. Therefore, it would have been obvious to one of 
ordinary skill in the art, having the Lanckton et al and Lachinski et al references in front of 
him/her and the general knowledge of camera selection features, would have had no difficulty in 
providing the digital matrix router 23 of Figures 3 and 4 of Lachinski et al for the advanced 
terrain mapping system as shown in Figure 1 of Lanckton et al so as to provide substantially the 
same if not the same desired camera selections for the same well known purposes as claimed. 
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7. Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

or faxed to: 

(703) 872-9314, (for formal communications intended for entry) 
(for informal or draft communications, please label "PROPOSED" or "DRAFT") 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal Drive, 
Arlington. VA., Sixth Floor (Receptionist). 

8. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Richard Lee whose telephone number is (703) 308-6612. The Examiner can 
normally be reached on Monday to Friday from 8:00 a.m. to 5:30 p.m, with alternate Fridays off. 

Any inquiry of a general nature or relating to the status of this application should be 
directed to the Group customer service whose telephone number is (703) 306-0377. 



Richard Lee/rl 

3/8/02 




